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Summary 
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In  the  theory  of /control  procesBee*  It  is  important  to 

\b  ® 

be  able  to  ce  leu  late — (xi  BK)dt  without  having  to  solve 

o 

explicitly  the  differential  equation  dx/dt  -  Ax,  x(0)  •  c. 

A  method  for  doing  this  Is  presented  In  thla  pai5er,  generalizing 
one  due  to  Arke  for  n^^  order  linear  differential  equation.  ^ 
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NOTES  ON  MATRIX  THEORY — X 
A  PROBLEM  IN  CONTROL 
By 

Richard  Bellman 


§1 .  Introduction 

In  a  recent  paper,  [l]*  Anke  showed  that  the  expression 

(1)  j 

o 

could  be  computed  as  a  rational  function  of  the  coefficients, 
ai,  In  the  differential  equation  for  x. 


(2) 


dt 


n 


-  a  1 


d K 


dt 


n— 1 


+  a,x. 


and  the  Initial  values  x(0)  ■  cj,  x’(0)  »  ca,...,x^*^  ^^(O)  ■  ^n— 1^ 

without  solving  the  equation  explicitly,  provided  that  all  the 
solutions  of  (2)  approached  zero  as  t — ycD  .  This  Is  equivalent 
to  the  condition  that  all  the  roots  of  the  equation 

( 3 )  a  I  -»■  ...  +  a^  -  0 


have  negative  real  parts.  Determinai.tal  criteria  for  this  were 
first  given  by  Hurwltz. 

In  this  paper  we  wish  to  consldei  the  more  general  problem 
of  determining  the  value  of 

OD 


(^) 


*  y"  (x,  Bx)dt 

o 
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under  the  assumption  that  x  is  the  solution  of 
(5)  ^  -  Ax,  x(0)  -  c, 

where  the  characteristic  roots  of  A  have  negative  real  parts; 
l.e.,  a  stability  matrix. 

§2 o  The  Anilytic  Procedure 

Lret  x  be  the  solution  of  (1.5)  and  compute,  for  F  a  constant 
symmetric  matrix, 

(1)  ^  (x,Fx)  -  (  Fx)  (x,  F  ^  ) 

«  (Ax,  Fx)  +  (x,  FAx) 

-  (x,  (A'F+FA)x). 

From  this  it  follows  that 

CD  .  CD 

(x,Fx)dt  .  y  (x,  (A-P  +  PA)x)<lt 

o  o 


or 

GO 

-(c,Fc)  -  ,/^  (x,(A'F  +  FA)x)dt, 

o 

since,  by  assumption  x(t)— >0  as  t - . 

Hence  if  F  is  determined  by  the  relation 

(3)  a»f  +  fa  »  B, 


we  have  a  solution  to  the  problem  posed  above. 
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§5 .  The  Matrix  Problem 

The  question  arises  as  to  the  existence  of  i  solution  of 
the  equation  In  (2.5)*  Fortunately  the  problem  can  be  resolved 
very  simply  by  means  of  a  transcendental  procedure.  It  Is  well— 
kiown  that  one  solution  of  this  equation  Is 

(1)  F  =  -(y^*e^*^Be^^dt, 

o 

well-defined  for  A  a  stability  matrix. 

Since  this  solution  exists  for  arbitrary  B,  It  follows 
that  It  Is  unique.  Hence  (2.3)  can  always  be  solved  by  the 
standard  determinantal  method. 

It  Is  Interesting  to  note  that  In  the  (2  x  2)  case,  the 
determinant  of  the  3  unknown  elements  In  the  symmetric  matrix 
F  is  the  product  of  tr  A  by  det  A.  The  conditions  that  A 
be  a  stability  matrix  are  that  tr  A  <  0,  det  P  >  0. 

It  is  tempting  to  conjecture  that  the  factors  of  the 
(fctermlnant  of  the  n(N  1  )/2  unknown  elements  In  the  symmetric 
matrix  r  In  the  general  case  constitute  a  set  of  Hurwltz 
crlte.'la  for  the  matrix.  In  the  case  N  •  3,  the  determinant 
Is  of  degree  6.  This  leaves  room  for  a  quadratic  factor  In 
addition  to  the  linear  factor,  tr  A,  and  the  cubic  factor  det  A. 

If  a  systematic  method  of  obtaining  these  factors  existed, 
the  problem  of  determining  stability  criteria  directly  In  terms 
of  the  elements  of  A,  rather  than  In  terms  of  the  coefficients 
of  the  characteristic  polynomial  of  A,  would  be  resolved. 
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